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I Decision  Process  Models  of  Peer  Ncininatians 

I Introduction 

In  a conprehensive  review  of  the  literature  on  peer  ncttdnations, 
t lewin  and  Zwany  (1976)  concluded  that  "peer  ratings  have  been  aipiri- 

cally  shewn  to  have  high  validity  in  the  prediction  of  diverse  future 
perfcntonce  criteria"  (p.  423) . They  noted  a lack  of  theory  in  this 

t 

area,  and  that  there  was  a need  for  an  ejq>lanation  of  the  actual  peer 
rating  process.  It  is  the  objective  of  this  research  to  develop  an 
[ infomation  processing  theory  of  the  judgemental  process  in  which 

L 

individuals  engage  while  rating  their  peers.  Following  the  research 
paradigm  proposed  ty  Lewin  and  Zwany  (1976) , enpirical  descriptive/ 

I predictive  models  of  the  peer  ncmination  process  are  derived,  using  a 

' class  of  enpirical  decision  process  models  of  the  thought  process 

f people  engage  in  while  rating  each  other.  Utilizing  protocol  tracing 

I ■ methods,  decision  process  models  are  constructed  on  how  individxaals 

I rate  their  peers  on  seven  widely  used  socianetric  questions:  (1)  Who 

i would  you  go  to  for  help  on  a tough  prcblem?;  (2)  Who  is  pulling  most 

I 

i for  the  group?;  (3)  IVho  was  best  at  handling  people?;  (4)  Who  has  the 

[ 

I most  ability  to  think  critically  and  anlaytically? ; (5)  With  \^an  can 

r you  work  best?;  (6)  Who  shews  the  greatest  independence  of  thought?; 

and  (7)  Who  has  the  best  overall  leadership  qualities? 

The  research  reported  in  this  paper  represents  an  initial  attenpt 
to  identify  and  test  the  predictive  validity  of  these  decision  process 
models.  It  should  be  noted  that  two  separate  but  identical  studies 
were  conducted.  Study  1 utilized  Duke  University  students  and  Study  2 
utilized  Naval  officers  who  were  students  at  the  Naval  Postgraduate 
School  in  Monterey.  This  paper  will  only  report  the  results  from  Study  1. 
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PiX)tocol  Tracing  and  Information  Processing  Models 

Part  of  the  difficulty  in  develcping  a model  of  decision  process 
behavior  comes  from  the  enpirical  procedures  often  enployed.  In  pre- 
vious research  on  decision  behavior,  subjects  are  viewed  as  a "black 
box."  In  otherwords,  focus  has  been  directed  toward  the  end  product 
of  the  decision  process  and  not  on  the  actual  process  of  how  the 
subject  reached  the  decision.  What  information  is  being  processed  in 
the  subject's  mind? 

Slovic  and  Lichtenstein  (1971) , in  their  review  of  the  literature 
dealing  with  the  modelling  of  human  decision  making,  concluded  that; 

"The  evidence  to  date  seems  to  indicate  that  subjects  are  processing 
information  in  ways  fundamentally  different. . . [from  those  of  the  tradi- 
tional regression  and  Bayesian  approaches] . . . .we  will  have  to  develop 
new  models  and  different  methods  of  experimentation."  (p.  729)  Ihey 
suggest  that  a promising  strategy  for  the  developnent  of  a theory  of 
human  judgement,  is  the  technique  of  cognitive  process  modelling. 

The  theory  and  enpirical  research  on  information  processing  can 
be  traced  to  the  work  hy  Newell,  Shaw  and  Simon  (1957) . Their  theory 
is  built  on  the  premise  that  such  processes  as  thought,  verbal  behavior, 
and  problem  solving  behaviors  are  performed  as  sequential  informaticn 
processing  steps.  These  "elementary  processes"  consist  of  such  opera- 
tions as:  storing  information  in  familiar  symbols  or  "chunks",  re- 
trieving it,  moving  it,  generating  transformed  data,  ccnparing  two 
synbols  for  equcility,  and  associating  two  syirbols.  In  otherwords 
these  elementary  processes  are  sijtple  logic  manipulations  of  data. 
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The  basis  of  cxjgnitive  process  modelling  tlieory  is  that  individuals 
solve  a problem  by  first  developing  a problem  space  — a psychological 
representation  of  the  tast  environment.  Intelligence,  the  information 
available  to  an  individual  from  his  memory,  and  the  objective  task 
environment  determine  the  problem  space.  Next,  the  space  is  searched 
for  a solution  by  means  of  a program.  In  otherwords,.  the  individual 
will  operate  upon  his  information  until  he  achieves  his  goal.  The 
fundamental  limitation  on  this  solution  process  is  the  ability  of  the 
individual  bo  store  data  in  a dynamic  (quickly  alterable)  memory. 

Newell  and  Simon  (1972)  conclude  that  individuals  cannot  store  more 
than  five  to  seven  symbols  in  a dynamic  memory;  therefore,  one  expects 
to  find  no  more  than  five  to  seven  dimensions  to  a problem  vhich  will 
be  considered,  no  matter  vhat  its  coiplexity.  Actually,  individuals 
usually  consider  fewer  than  five  aspects  of  a problem.  Newell  et.al. 
(1972)  contend  that  abstractions  fran  "reality"  characteristically 
involve  perhaps  only  two  symbolic  representations  at  any  given  time. 

Cognitive  process  programs  are  constructed  from  information 
elicited  by  a subject  vhile  performing  a task.  One  method  of  collect- 
ing this  infomation  is  by  obtaining  a verbal  self-report  from  the  sub- 
ject as  he  solves  a problem.  This  record  of  the  subject's  reported 
thou^t  process  is  )aicwn  as  a protocol.  The  value  of  this  method  of 
obtaining  the  decision  process  behavior,  has  been  noted  by  Simon  (1976) : 


[a]  technique. .. .used  to  increase  the  density  of  observations  of 


the  information-processing  system  stream  [is]  recording  think-aloud  pro- 
tocols of  the  problem  solver's  verbalizations  during  his  activity."  (p.28) 
Similarly  Payne  (1976),  in  an  analys  ' of  the  veurious  models  of  decision 
making,  concluded  that  asJcing  subjects  to  "think  aloud"  while  naking 
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their  decisions,  provides  valuable  insights  into  tlie  information 
processing  strategies  which  led  a subject  to  make  a particular 
choice.  Newell  (1966)  has  developed  a methodology  for  the  analysis 
of  protocols  based  upon  content  analysis.  Ilis  procc-dure  allows  for 
the  discovery  of  the  patterns  of  thouglit  which  underlie  behavior. 

Protocol  tracing  techniques  were  successfully  applied  on  an 
exploratory  basis  by  Akula  (1969)  to  develop  cognitive  process  models 
of  the  peer  rating  process.  He  concluded; 

"there  was  a significant  tendency  for 

the  [subjects]  to  use  only  a few  standards  in 
reaching  peer  rating  evali;iations There- 

fore, these  results  suggest  that  the  selections 
made  by  peer  rating  protocols  tend  to  involve 
only  one  or  two  key  diiriensions  which  are  cjuite 
cermon  to  the  protocol  respondents.  The  pjroto- 
col  methodology  facilitated  the  identification 
of  behavioral  dimensions  affecting  the  peer 
rating  process.  This  source  of  cjrpirical  in- 
formation provided  the  basis  for  formulating 
conceptual  frameworks  (models)  of  these  diircn- 
sions  in  a sequential  relationship."  (p.  72-73). 

Since  the  judgemental  process  of  peer  evaluatioas  can  be  viewed 
as  a special  case  of  problem  solving  behavior,  then  the  next  steps 
involve  identifying  the  problem  space  (perception  of  the  task  environ- 
ment) , and  the  program  used  to  search  the  space  for  a solution  (the 
cognitive  processes  which  result  in  the  actual  peer  ratings) . Problem 
spaces  and  programs  arc  isolated  frem  protocols  and  intervieitfs  with 
"performing"  subjects.  Once  the  program  is  isolated,  the  emiprical- 
level  theory  has  been  developed. 

Therefore,  th2  strategy  used  in  this  stxxly  was  to  derive  descrip- 
tive/predictive models  of  the  peer  ncmination  process  using  protocol 
tracing  tecJiniques.  In  otlicrwords,  this  approach  involves  developing 
decision  process  theories  fran  cin  analysis  of  the  data  — ver)xjl 


r 

I 

self-reports  of  subjects'  thought  processes  v;hile  engaged  in  making 
peer  judgements . 

METHOD 


Overview 

The  procedure  in  tliese  studi.es  was  adapted  frem  Akula  (1969) . 

The  ej^rimental  environment  simolated  managerial  decision  making. 

It  was  chosen  because  the  predictiveness  of  peer  evaluatiens. . . . 
"depends  in  part  upon  how  closely  the  rated  activities  simulate 
real-life  leadership  situations."  (Roadman,  1964,  p.  211).  The 
socicrnetric  instrument  used  in  this  research  was  conposed  of  seven 
items  that  Hollander  (1965),  Weitz  (1958),  and  Roadman  (1964)  found 
to  be  valid  predictors  of  future  performance. 

Titfo  studies  were  conducted:  the  first  with  Duke  University 
students  as  subjects,  the  second  \d.th  officers  at  tlie  Naval  Post- 
graduate School  in  Monterey.  Subjects  were  merriDers  of  seven-person 
teams  participating  in  a management  simulation.  They  \irere  to  assune 
the  role  of  management  consul taiits  hired  by  a hypothetical  cenpany. 
After  reviewing  the  present  state  of  the  coipany,  th^  were  to  analyze 
its  problems  eind  arrive  at  initieil  recemnendations  to  be  made  to  top 
management.  In  order  to  make  sure  that  no  person  was  predesignated 
as  the  group  leader,  it  was  arranged  for  them  to  convene  in  the 
absence  of  the  project  beam  leader.  Ten  such  teams  were  run  in  each 
stuly. 


J 
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Each  simulation  required  aFproximately  2 1/2  consecutive  hours 
! to  conplete.  A total  of  six  phases  ccttprised  the  entire  procedure: 

(1)  subjects  received  an  orientation;  (2)  case  material  about  the 
hypothetical  corpany  was  read  individually  by  each  student;  (3)  the 
case  was  jointly  discussed  and  analyzed  by  the  group  to  arrive  at 
preliminary'  recamendations  (this  phase  was  videotaped) ; (4)  subjects 
viaved  themselves  on  videotape;  (5)  the  seven  item  peer  evaluation 
forms  were  cotpleted;  and  (6)  protocols  were  obtained  for  each  of 
the  se\'en  questions  in  both  studies. 

The  procedures  in  the  two  studies  were  identical.  In  addition, 
all  subjects  in  Study  2 were  administered  various  personality  tests. 

The  tests  administered  included  the  Edwards  Personality  Preference 
Schedule,  the  California  Psychological  Inventory,  the  Least-preferred 
Co-worker  Score,  a test  for  Machiavellianism,  and  the  California  F- 
, test  for  authoritarianism.  At  this  time  the  ^lnalysis  for  Study  2 

has  not  yet  been  cotpleted.  Therefore,  only  the  results  for  Study  1 
will  be  presented  in  this  paper. 

Subjects.  All  subjects  in  Study  1 were  sunmer  school  students 
at  Duke  University.  The  65  participants  were  all  of  college  age  and 
were  paid  volunteers.  The  sex  mix  was  not  controlled  resulting  in  a 
randan  distributioi  of  males  and  females  for  each  of  the  test  teams. 

Full  attendance  was  assured  by  over-scheduling  each  test  session  by 
one  or  two  persons.  If  eight  persons  showed  ip)  for  the  testing,  one 
member  was  assigned  to  be  the  project  team  leader  who  was  subsequently 
excused  after  the  iixdividual  reading  of  the  case.  Despite  these  extra 
efforts,  one  group  was  short  one  subject  and  another  was  short  two 
subjects. 

J 
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Prica:  acquaintanceship  was  minimized  as  much  as  possible.  Ha-vover, 
on  occasion  two  friends  did  participate  in  the  sane  group.  Before  the 
start  of  each  test  session  cin  indication  of  prior  acquaintanceship 
and/or  friendships  was  obtained. 

Stimuli . The  stimuli  was  a peer  evaluation  questionnaire. 

It  consisted  of  seven  items  selected  from  those  that  Hollander  (1965) , 

I'Jeitz  (1958) , and  Roadnan  (1964) , found  to  be  valid  predictors  of 
managerial  success.  The  questions  \ijere  as  follows: 

1.  Who  would  you  prefer  to  go  to  for  help  on  a tough 
pr<±ilem?  (Weitz) 

2.  Who  is  pulling  most  for  the  groi:^)?  (VJeitz)  ’ 

\ 

3.  Who  is  best  at  handling  people?  (Vfeitz)  * 

4.  Who  has  the  most  ability  to  think  critically  and 
analytically?  (Roadnan) 

5.  With  vdiom  can  you  work  best?  (Weitz) 

6.  Who  shows  the  greatest  independence  of  thou^t?  (Roadman) 

7.  Who  has  the  best  cfverall  leadership  qualities?  (Roadman)  4 

1 

Subjects  were  asked  to  exclude  themselves  and  rank  the  mentoers  in  | 

their  group  frctn  first  to  last  on  each  of  the  qiiestions-  | 

J 

I 

Although  the  set  of  questions  in  the  peer  rating  instrument  consistea 
of  seven  items,  each  questionnaire  booklet  contained-  only  six  of  the  seven 
socicjTetric  measures,  with  one  question  systematically  emitted  frem  each 
booklet.  The  procedure  \-ras  constructed  in  such  a way  that  the  subject 
would  have  an  unfamiliar  qpjestion  for  \iiiich  to  give  a protocol.  In  order 
to  achieve  an  equal  number  of  protocols  for  all  seven  measures,  the  omitted 
qxxjstion  alternated  in  each  booklet. 


I, 
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Pi~ocedurc.  (Pliase  One)  Subjects  were  seated  in  a semi-circle  facing 
the  videotape  camera.  Receiit  research  indicates  that  this  physical  arrange- 
ment is  not  detrimental  to  group  behaviors  (Lonetto,  1973) . Subjects  were 
told  tliat  they  were  involved  in  an  exercise  examining  how  a group  a^^proaches 
an  unstructured  problem  situation.  They  were  told  vjhat  the  entire  process 
would  involve,  briefly  describing  each  phase  of  the  exercise,  and  that 
their  group  discussions  would  be  videotaped.  It  was  stressed  that  the 
researdiers  were  not  interested  in  anything  about  them  as  individuals. 

Each  participant  wore  a name  tag  bearing  only  Ms  or  her  first  name  to  in- 
sure anonymity,  Ihey  were  also  asked  to  make  an  effort  to  match  tfie  nanes  . 
with  the  faces  of  the  other  neirbers  in  the  group  to  facilitate  later  recall. 

(Phase  'hro)  Case  material  was  distributed  along  with  a pencil 
and  writing  pad  for  note  taking,  if  desired.  Approximately  20  minutes 
was  alla-^ed  for  reviesMng  the  case. 

(Phase  Three)  Instructions  for  this  phase  of  the  experiment  were 
re-read.  Sx±>jects  \^7ere  told  they  were  na-f  to  convene  as  a project 
staff  meeting  to  prepare  preliminary  recarmendations . They  were 
also  meeting  in  the  surprise  absence  of  the  project  team  leader  who 
was  called  away  on  urgent  business.  If  an  eighth  team  member  was 
present,  he  was  excused  at  this  time  as  the  leader.  The  videotape 
was  started  and  discussion  was  stopped  after  30  minutes. 

(Phase  Four)  The  videotape  of  the  group  discussion  was  replayed 
for  the  purpose  of  letting  the  subjects  sea  how  they  functioned  as  a 
group  and  to  refresh  their  notories  as  to  what  was  said.  Interest  in 
the  I'eplay  was  usually  lost  within  15  minutes,  wherein  the  next  phase 
Wcis  begun. 
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(PhasG  Five)  Itie  peer  evaluation  instrument  was  distributed.  Sub- 
jec±s  were  asked  to  disperse  around  the  roara  in  order  to  fill  out  the 
questionnaires  in  greater  privacy. 

(Phase  Six)  After  the  questionnaire  tos  corrpleted,  each  subject 
was  taken  into  a separate  office  to  be  intervie\\’ed  privately.  At  the 
start  of  the  intemdeii;,  permission  v.’as  obtained  for  recording  the 
session  and  the  subject  was  told  that  he  could  listen  to  tiie  tape  at 
the  conclusion  of  the  interview  if  he  desired.  The  recorder  was  then 
started  to  get  the  subject  comfortable  with  a tape  recorder  before  the 
actual  question  was  asked.  He  was  then  told  that  the  researchers'  main 
interest  was  in  the  thought  process  involved  in  iraking  a decision.  The 
subject  would  be  asked  to  think  aloud,  to  verbalize  his  thoughts,  as 
he  answered  a question  similar  to  the  ones  in  the  questionnaire.  He 
was  to  say  whatever  cams  into  his  mind,  ha-jever  silly,  iirpolite,  irre- 
levant, fragmentary’'  or  uninportant.  And  whenever  he  should  fall  silent 
for  more  than  a moment  he  would  be  asked  "to  please  ta]Jc...." 

Next  a practice  question  was  tried  to  give  the  subject  an  idea 
of  vhat  it  was  like  to  verbalize  his  or  her  thoughts.  The  question 
used  was  a simple  cryptarithmetic  problem.  Subjects  were  to  solve, 
by  thinking  out  aloud,  the  values  of  the  letters  B,  O,  and  J,  gi\’en 
the  value  of  the  letter  E and  the  numeral  value  of  the  sum: 

BOB 
•f  JOE 

6 2 7 E = 3 

After  the  subject  solved  the  trial  problem  aloud,  it  was  reviev^, 
pointing  out  tJie  entire  thought  process,  e.g.  "You  said,  or  shoiild  liave 
said,  'siiice  E equals  3,  and  this  is  a problem  in  addition,  then  7 minus 
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3 equals  4,  tJierefore,  B equals  4 because  4 plus  3 equals  7,'  etc.  hliat 
the  researchers  are  after  is  a state-aent  of  the  entire  chain  of  thoughts." 

Next  the  rele^^t  experiiriental  sociaretric  question  was  presented. 

The  subject  v/as  told  to  think  back  of  the  group  interaction,  and  again, 
excluding  himself,  to  rank  the  mentoers  in  his  group  frcm  first  to  last 
remembering  to  verbalize  everything  that  he  is  thinking.  The  question 
was  tlien  read  to  the  subject  and  also  presented  on  a 7"  x 9"  index 
card  placed  before  him  for  reference-  In  addition,  the  seating  arrange- 
ment of  the  group  was  ired'e  available  to  the  sihject  to  help  him  recall 
vdio  was  vdio. 

During  the  subjects  verbal  report,  the  intervdewer  v?ould  varite 
dCT-m  what  appeared  to  be  nonoperational  statements  and  code  words 
for  corplete  thou^t  process  strings  vhich  the  subject  would  verbalize 
in  his  evaluations.  Examples  are  the  use  of  code  words  such  as 
"intelligent",  "friendly",  etc.  The  cperational  meanings  of  these 
words  or  phrases  were  then  explored  with  the  subject. 

At  the  conclusion  of  the  interview,  vhen  the  subject  had  no  more 
thoughts,  all  questions  or  ccrrnents  that  he  might  have  concerning  the 
experiment  were  ans^s’ered;  and  he  was  allaced  to  listen  to  his  recording. 
Subjects  \\«re  informed  that  tlie  results  of  tlieir  peer  evaluations  (i.e. 
hew  they  were  perceived  by  their  group  members)  would  be  available  upon 
regvest.  Only  aggregate  ranks  were  reported  to  maintain  anonymity. 

For  samples  of  all  instructional  materials,  the  case,  and 
questionnaires  see  Technical  Report  No.  2. 
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RESULTS 

Protocol  Analysis 

A conplete  transcript  of  the  verbal  reports  giv'en  by  each  subject 
was  trade.  Using  the  procedure  suggested  by  Newell  and  Sitron  (1972) , 
the  protocols  w’ere  broken  up  into  short  phrases  each  representing  the 
subjects'  assessment  of  ho*'  he  was  rctnking  a person  a particular  way. 
Neivell  and  Simon  (1972)  have  shavn  that  breaking  verbal  protocols  into 
small  phrases  "goes  a long  way  tor^ards  isolating  a series  of  unairbiguious 
'measureiTients'  of  \i^at  information  tine  subject  had  at  particular  times" 

(p.  166). 

Once  the  protocols  w’ere  broken  davn  into  short  phrases  they  were 
then  analyzed  for  operational  and  nonoperational  infonmtion  processing 
descriptors  of  the  subject's  thought  process.  Operational  descriptors 
refer  to  statements  about  behavior  \\irLch  are  tangible,  observable  and 
neasurable.  For  exanple,  the  statanent  "agreed  with  im"  is  defined  as 
operational  because  it  connotes  a specific  agreement,  v^ch  can  be 
reliably  scored.  It  is  also  possible  to  signify  agreement  with  a non- 
verbal comminication  v;hich  can  also  be  reliably  scored  (e.g.  head  nodding) . 
Havcver,  the  statement  "he  seamed  personable"  is  considered  to  be  a non- 
opera  tional  verbal  description.  It  does  not  suggest  any  specific  be- 
haviors which  tile  person  being  described,  engaged  in,  that  n«ke  him 
"personable." 

Group  Videotape  Content  Analysis 

Fran  the  analyses  of  the  protocols,  various  content  categories  \\Rare 
identified,  (e.g.  gives  direction,  sumnrarizes,  asks  questions,  etc.) 


^ 
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These  categories  — suggested  by  tlie  protocols  as  being  tl'e  chun}:s  of 
information  used  by  an  individual  in  ma3djrig  decisions  — were  then  used 
as  the  basis  for  einalyzing  and  scoring  the  content  of  the  videotaped 
group  interactions.  Initially,  only  verbal  ccmmunications  v;ere  content 
analyzed  and  scored.  It  became  evident,  ha*;ever,  that  subjects  v.’ere 
also  processing  a variety  of  nonverbal  cues  for  wlrich  no  operational 
definitions  were  available.  Subjects  for  exairple  evaluated  the  extent 
to  which  other  group  nenbers  were  "listening",  seemed  "open  and  relaxed" 
and  so  forth.  A study  of  the  nonverbal  literature  (Knapp  1972;  tJehrabian 
1972)  indicated  that  tlie  nonverbal  behavior  (e.g.  listening,  daninance, 
inmediacy,  etc.)  could  be  reliably  scored  and  thereby  significantly 
increase  the  subset  of  information  being  processed  by  the  subjects  . 

Searching  the  record  of  the  verbal  transactions  for  these  content 
categories  in  each  group  videotape  involved  three  tine  consuming  steps: 

1)  A sequential  list  of  the  order  of  speakers  was  made 

by  tvi?o  observers  \<ho  independently  recorded  this  infor- 
mation, after  v;hich  the  tv/o  lists  were  cross  checked 
and  reconciled. 

2)  The  audio  was  transcribed.  This  time  consuming  step 

greatly  facilitated  the  ana]ysis  of  the  verbal  trans- 
actions. Onoe  a transcription  was  made  of  each  video- 
tape, each  verbal  ccnment  was  anal^^zed  ard  scored  as 
to  which  content  category  it  belonged.  For  example, 
the  statanent  "Yes  I agree , and  vdiat  you  said  could . 
also  apply  to  Marketing  because  ", 


would  be  scored  as  an  agreorvant,  and  as  building 
on  a previous  statement. 


3)  The  videotape  was  scored  for  nonverbal  caitnunica- 
tions,  (e.g.  headnodding,  listening,  eye  contact, 
etc.) . As  was  suggested  by  Heimann  and  Heiirann 
(1972) , tlie  videotape  \iras  viewed  "v;ith  and  with- 
out sound  for  concentration  on  the  nonverbal 

expressions  that  direct  observation  diffuses" 

(p.  80) . Again,  tvra  ctoser\^ers  scored  these  cate- 
gories independently.* 

Fran  this  record  of  the  caimunications , each  individuals'  contri- 
butions were  extracted  and  sunmed.  In  otherV';ords,  for  each  subj«rt 
a record  was  made  of  the  nunber  of  times  he  agreed,  disagreed,  expressed 
an  opinion,  etc.  This  data  was  then  used  as  inputs  to  the  peer  ranking 
models  for  predicting  hw  a subject  would  be  rated  on  each  socicnetric 
by  tlie  group. 

Decision  Process  Models 

No  a priori  models  of  the  subjecrts  decisicn  behavior  were  pcstulated 
in  this  research.  The  protccol  tracing  irethodologi'’  is  intended  to  pro- 
vide a process  descripticsn  of  the  informatics  processing  strategies 
enp'  yed  by  subjects  vhile  evaluating  tlieir  peers. 

It  was  e>q3ected  that  a content  einalysis  of  the  d^criptors  {opera- 
tional and  nonoperational) , obtained  from  the  deccnpcsiticn  of  each 

* The  nedian  interrater  agreorvait.was  .98  vdtli  a range  of  .95-53  to  ,9933 
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protocol,  \vould  identifi'  a few  key  dimensions  which  subjects  con- 
sidered in  evaluating  their  peers.  Based  on  prior  research  and  a 
review  of  tlie  literature  (Le^n  and  Zw£my  1976)  it  was  expected  that 
these  dimensions  wuld  be  situationally  carmon  for  a particular  socio- 
instric  question.  In  other  \A)ords,  a ccraion  core  of  criteria  used  by 
subjects  to  evaluate  their  peers  on  a particulcu:  socicmetric  question 
for  the  Duke  su):)jects  was  expected  to  be  found.  ITie  models  v/hich 
were  develcped  and  the  initial  results  of  the  anafysis  are  considered 
to  be  the  siirplest  and  most  naive. 

Since  an  examination  of  the  protocols  yielded  only  inforrration 
categories  considered  by  subjects  witl:iout  providing  any  indications 
as  to  priority  levels  of  the  information,  a sirrple  uraveighted  addi- 
tive model  was  hypothesized  for  each  socioretric  question.  The  basic 
model  for  each  question  considered  only  the  carmon  priirary  factors 
\iMch  appeared  in  each  protocol.  For  example  for  socicmetric  question 
#5,  "With  wham  can  you  work  best?",  the  single  primary  factor  was: 

Mutual  Influence  - the  existence  of  give  and 
take  in  the  interaction  between  bra  or  more  group 
members  with  no  individual  imposing  his  ideas  or 
trying  to  daninate  the  interchange. 

From  the  extracted  descriptor  phrases  in  the  protocols,  several 
recurring  themes  v.’sre  gleaned.  A frequency  analysis  of  these  phrases 
suggested  the  following  primary  factors:  (1)  a Mutual  Influencing  ex- 
change (MI) , (2)  having  the  ability  to  Listen  (L)  , (3)  the  Quantity  of 
Verbal  Connunicaticn  (QVC) , (4)  engaging  in  a Social-Directive  role  (SD) 
and  (5)  Categorizing  and  Surtr.iarizing  information  (C/S) . Tlie  primary  fac- 
tors which  wore  eiplo^^cd  in  the  )jasic  urr.raighted  additive  mxxiels  for 
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each  socianetric  question  are  sunmarizod  in  Table  1.  'Ihe  frequency  with 
vMch  these  factors  occured  in  the  protocols  for  the  particular  socio- 


metric  is  also  presented. 


Table  1.  Sutmicury  of  Key  Parameters  for  each  Sociometric  Question 


i 

1 

i 

I 


Sociometric 


Frequency  Stated 

Primary  Factors in  Protocols 


1. 

Who  would  you  go  to  for  help 

MI 

32% 

on  a tough  problem? 

L 

32% 

2. 

Who  is  pulling  most  for  the 

SD 

27% 

group? 

L 

27% 

QVC 

24% 

3. 

Vflio  is  best  at  handling  people? 

SD 

42% 

MI 

31% 

4. 

Who  has  the  most  ability  to  think 

QVC 

33% 

critically  and  analytically? 

C/S 

33% 

5. 

With  \diom  can  you  work  best? 

MI 

60% 

6. 

Who  has  the  greatest  independence 

No  clear 

of  thought? 

indication 

7. 

Who  shows  the  best  overall 

SD 

48% 

leadership  qualities? 

MI 

32% 

In  the  follcx^ang  section  exerpts  from  the  protocols  are  presented. 
These  descriptor  piirases  aid  in  tJie  understanding  of  the  meaning  of  the 
primary  laarameters.  For  a Scmple  of  a coxplete  protocol  transcript 
see  Teclinical  Report  No.  2. 

The  Mutual  Influence  factor  is  identified  by  the  existence 
of  throe  beliaviors:  (1)  a give  and  take  excliange,  (2)  liaving  the 
ability  to  listen,  emd  (3)  not  being  overly  dogmatic  or  aggressive 
in  your  vie\vs.  A give  and  take  exchange  is  represented,  for  example, 
by  the  following  underlined  descriptors: 


Sji^:  I feel  like  if  I have  scmeone  vho's 
confident  of  v^hat  we  can.  do  \d.thin 
reasonable  limitations, 

then  I feel  like  I can  take  this 
information  to  this  person 


and  he  can  di.gGSt  it 


and  because  of  his  relationsMp  with 
other  people  he  can  expound  a bit 
more  intelligently,  and  a bit  more 


convincingly  on 


but  we  both  contributed 


S^:  He  doesn't  just 
time. 


with  you  all  the 


S^:  We  were  job 


finding  solutions. 


S^:  I agree  with  vhat  she  said,  but 
I could  {>ersuade  her  to  my  way 
of  thinJang  scnotimes  if  we  disagreed. 


The  dGscrj.ptors  in  a give  and  take  exchange  include  those  whidi  indicate 
agreement,  disagreement  and  building  on  anothers  idea. 


} 
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llio  listening  aspect  of  tJie  mutual  ijifluencing  process  is  evident 
in  the  folloiving  descriptors: 

He  responds  to  \v’hat  people  say 
and  draws  my  thoughts  into  the  group. 

82!  He  both  listenod  and  spo}:e. 

S^:  She  was  interested  in  keeping  up  all 
the  time,  she  didn't  just  sit  back, 
and  gave  feedback. 

S^:  I could  work  with  Laura  best  because 
she's  willing  to  listen  to  you 

and  I don't  think  she'd  deminate  or 
restrict  me  frat  adding  side. 

I feel  like  both  of  us  could  contribute 
together  and  it  wouldn't  be  a one-sided 
contribution. 

It  is  logical  that  in  order  to  have  give  and  take,  each  person 
involved  in  the  discourse  must  equally  be  a listener  as  well  as  a 
contributor  to  the  discussion.  Poor  listening  abilities  also  charac- 
terizes the  dogmatic-aggressive  individual.  Following  Rokeach's 
(1954)  definition  of  dognatism,  the  dogmatic  person  can  be  described 
as  closed-minded,  rigid,  and  intolerant  of  other's  opinions,  especially 
when  they  differ  from  his  own  beliefs.  This  qmlity  was  evident  non- 
verbally through  such  cues  as  rigid  body  posture,  crossed  arms, 
leaning  backward  outside  of  tlie  group,  etc.  These  persons  were 
perceived  as  being  cold,  aloof,  and  not  open  to  persuation.  Dog- 
matism and  aggression  was  described  in  the  protocols  such  verbal 
descriptors  as; 

He  internets 

82:  Ifo  was  overly  aggressive  and 
dominated  the  conversation. 


A 


S^:  He  felt  like  his  ideas  were  the 
right  ones. 

and  he  wasn't  open  to  anianriment. 

S.:  I felt  like  he  would  can""  down 
4 

hard  on  scncones  negative  opinions , 
and  he  wouldn't  be  tactful  v.tieit  he 
disagreed. 


He  smiles  axxi  is  friendly,  giNos 
everyone  a ch^ince,  emd  doesn't  interrxpt. 
She  was  receptive  to  other  peoples' 
opinions  cind  is  willing  to  interject 
her  avn  ideas. 

He  was  too  aggressive  and  thoui^t  things 
had  to  be  done  his  way. 


I think  v^en  you  encounter  someone  \'rfio 
thinks  along  those  lines 


there's  conflict  already 

instead  of  it  being  a ccnplimsntarv/  pro- 
cess towards  solving  probJ.ems 

it  becomes  more  of  a conflictive  type 
of  thing 

because  you  have  to  overcome  tire  roadblocks 
they  have  set  up  in  their  a^m  minds. 


This  rigid,  aggressive  cind  dogmatic  quality  was  primarily  scored  tJirou^ 
the  nonverbal  cues  by  two  independent  observers,  it  v;as  then  added  to  a 
count  of  verbal  statorents  of  disagreement,  agreement,  and  building  ex- 
pressed by  a si±>ject  to  obtain  the  final  Mutual  Influence  score. 

This  factor  vas  found  to  be  of  prinary  iirportance  in  the  socio- 
metric "With  wham  can  you  work  best?".  Tlie  existence  of  give  and  take. 
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listeninq,  and  the  absence  of  dogrratic-aggiressive  behavior  are  all  com-  ; 

bined  in  the  decision  of  tlie  peer  ranking  on  this  question.  Mutual 
InflutTice  was  also  found  to  1x5  iinix)rtant  in  the  protocols  on  "Uhom 
would  you  go  to  for  help  on  a tough  problan?",  "Who  is  best  at  handling 
people?",  and  "Who  shows  the  best  overall  leadership  cp.ialities?" 

Curiously  enough,  however,  the  carponents  of  give  and  talce  and 

listening  were  represented,  but  little  mention  was  made  that  the  ' 

I 

restrictive  nature  of  the  dogmatic-aggressive  individual  was  un- 
desirable on  these  tliree  sociometrics . 

The  factor  of  L.isteninq  was  apparent  in  both  the  verbal  and  non- 
verbal coitnunications.  It  is  revealed  verbally,  for  exanple,  in  the 
following  exerpts  fron  the  protocols: 

1 

She  listened  and  spoke. 

82!  He  agreed  with  me 

and  I felt  like  he  valued  what  I said. 

i 

Sj ! He  didn't  interrupt  serreone  else 

J 

was  talking.  j 

i 

All  of  these  descriptors  indicate  that  sertveone  is  listening  to  v^at  is 

being  said.  Nonverbal  cues  include  eye  contact,  head 

nodding,  leaning  forwcud  toward  the  speaker,  etc.  Listening  was  scored 

by  bvo  independent  observers  who  watched  the  videotapes  mthout  the  1 

i 

sound  (Ilcimann  and  Heimann  1972)  in  order  to  focus  solely  on  the  non- 
verbal cues.  The  Listening  factor  was  found  to  be  particularly  inpor- 
tant  in  the  socicmctrics  "Wliom  would  you  go  to  for  help  on  a tough  preto- 
1cm?",  and  "V\ho  is  best  at  handling  peqDle?" 
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The  factor  of  Categorizing  or  Sunrorizing  is  cxGTplified  by  the 
follah.ng  descriptors; 

He  was  able  to  folla.7  the  conversation 
and  ccsne  up  with  em  appropx-Tate  obser- 
vation. 

S2:  He  crystalized  the  group  tixought  to 
suiTiiarize. 

S^:  He  was  organized  in  the  way  he  vras 
thi irking  about  tilings 

Ho  could  focus  on  one  thing  and  move  to 
the  next 

S^;  I would  say  sonething 

and  she  seeired  able  to  drav,”  it  together 

If  people  made  general  staterrents,  she 
would  not  only  initiate  stuff,  but 
categorize  it; 

like  I'd  cane  out  with  generalizations 
and  she'd  categorize  it  and  put  it  sort 
of  into  a pocket. 

S^:  He  was  able  to  look  at  both  sides  of  the 
situation  and  reach  a conclusion. 


Each  tini3  a subject  made  a statement  which  tied  ts-.’o  ideas  together, 
review  v^hat  had  already  been  said,  etc.,  it  was  scored  as  a Catagori- 
zing/Sujnmrizing  behavior.  This  factor  was  primarily  found  in  the 
socionctric  "I'Jho  has  the  most  ability  to  think  critically  and  analyti- 
cally?" 

The  factor  of  the  Quanity  of  Verbal  Canmunication  (QVC)  is  revealed 
in  the  protocols  by  such  descriptors  as: 

Sj^:  He  talkod  the  most 

S2:  John  was  most  verbal 

S,:  She  had  the  most  ideas,  she  contributed 
the  nxist.  "" 
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This  factor  ras  scored  from  a count  of  the  nunibcr  of  utterances  trade 
by  each  subject.  A finer  classification  of  the  Quantity  of  Verbal  Cent- 
munication  was  iiade  using  tlie  nuirbor  of  cpiniens  stated  hy  £in  individual 
as  a subset.  Tlxis  measure  of  verbal  f>articipatiar  proved  to  be  a more 
significant  ntcasure  and  therefore,  was  used  whenever  "taUcative" 
appeared  frequently  in  the  protocols  on  a pcirticular  socicnetric. 

Tliis  factor  was  found  to  be  iirportant  in  naking  tlie  peer  rankings  on 
the  socicmetrics  "Who  is  pulling  most  for  the  group?"  and  "l*Jho  has  the 
most  ability  to  think  critically  and  analytically?" 

The  Social-Directive  factor  is  characterized  by  an  individual 
who  (1)  organizes  and  gives  direction  to  the  group  and  (2)  acccnplislies 
this  in  a socially  acceptable  manner.  In  othenrords,  a person  rarfeing 
high  on  this  dimension  not  only  structures  the  problem  solving  process 
of  the  group  but  he  or  she  also  involves  other  grorp  members.  This 
includes,  listening,  drawing  others  out,  ^md  not  imposing  one's  will. 
These  behaviors  are  illustrated  in  the  follcv;ing  descriptors: 

He  takes  leadersMp  b^'  directing 
the  fla>v  of  thouglits  with  Ms  aim 

S2:  He  started  the  v;hole  discussion  off 

and  got  things  going  at  the  beginning. 

When  the  conversation  died  da^m,  he 
would  ask  if  anyone  else  had  aiiy  ideas . 

He  would  try  to  get  res;x:)nse  from 
other  pecple. 

S,:  He  would  bring  us  back  on  track  when 
the  conversation  drifted. 

S^:  He  gave  the  group  structure,  told  us 
vdien  to  move  on,  assigne-d  someone  to 
take  notes,  asked  questions  of  the  group 
and  of  people  v,ho  weren't  talking  to  draw 
tliem  out. 


I 
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He  pushes  his  i dcas  over  in  a 
pleasant  way,  cind  v.’hen  he  spoke 
we  listened. 

S^:  He  tcx3k  initiative  to  start  off 
tlie  v.tiole  thing. 

S,:  He  sat  up,  said  what  he  wanted 

to  say;  Jack  has  self-confidence . 

S_:  She  didn't  just  sit  back  all  the 
' time  but  she  wasn'_t  b?ligerent  in 
expressing  her  vie^'/s  either. 

This  factor  was  scored  two  independent  observers  v^io  ranked 
each  subject  as  either  high,  medium,  or  1cm.*  The  score  combined 
a count  of  tlic  verbal  structuring  and  consideration  behaviors  with 
special  emphasis  on  nonverbal  cues  such  as  those  indicating  readiness, 
openess,  self-confidence,  listening,  etc. 

Social-Directive  descriptors  appeared  most  frequently  in  tlie 
protocols  on  tlie  sociometric  "V\ho  v\’as  pulling  most  for  the  group?", 
"Who  is  best  at  handling  pecple?",  and  "Who  shavs  the  best  overall 
leadership  qualities?". 

Testing  the  Ifodels 

Ihe  development  of  the  models  consisted  of  two  ixia-ts:  (1)  the 
infornotion  chunks  being  processed  cuad  used  in  making  the  decisions 
on  each  socicmetric  were  identified  from  the  protocols;  and  (2)  the 
decision  rules  for  corbining  tlais  information  in  order  to  make  predic- 
tions as  to  the  aggregate  group  peer  rankings  for  each  group  nember 
were  identified,  for  exarqalc,  the  primary  factors  in  the  model  for 
the  sociometric  question  "\^io  would  you  go  to  for  help  on  a tough 
problem?"  are  l!utual  Influence  and  Listening.  The  decision  rules 

* I'he  median  interrater  relialeility  as  measured  by  the  Spearman  Rank 
Correlation  was  .981,  witJi  a range  between  .964  and  .998. 


for  predicting  the  peer  ranking  on  tliis  question  would  Ijg  to:  (i)  raak 
each  group  r.neiiibcr  according  to  the  additive  score  of  "agreements," 
"disagreeFients" , and  "building"  since  tliese  factoi's  ccxnj/jse  the  Mutual 
Influence  paraneter;  (ii)  ran}:  tne  group  members  on  the  nonverbal 
cues  indicati  ng  Listcnaiiug;  and  (iii)  catbino  the  t\‘K)  ranluings.  This 
fiml  racking  is  then  statisticiilly  corpared  to  the  actual  aggregate 
group  rankings.  The  decision  rules  for  all  of  the  socioiTietrics  are 
as  follo.';s: 

(1)  i^o  would  you  prefer  to  go  to  for  help  on  a 
tough  problem? 

Primary  paraiteters:  Mutual  Influence  and  Listening 
Information  processing  rales: 

i  - Ran}:  group  on  Listeiing  (L) 
ii  - Rank  group  on  Huti.ial  Influence  (MI) 
iii  - Combine  the  rankings 

(2)  iiho  is  puJ.ling  most  for  the  group? 

Prijrary  parameters:  Social-Directive,  Listening 

and  Quanti  ty  of  Verbal  CotTiTonication 
Infonration  processing  rules: 

i - Rank  group  on  Social-Directive  (SD) 

ii  - Reink  group  on  Quantity  of  Verbal 

CoTiTunication  (QVC) 
iii  - Rank  group  on  Listening  (I,) 
iv  - Carbine  tire  ranidngs 

(3)  }"Jho  is  best  at  handling  people? 

Primarg^  par:m\eters:  Saoial-Di  recti ve  and  Mutual 

Influence 

Information  processing  rules: 

i - Rank  group  on  Mutual  Influence  (MI) 

ii  - Rank  group  on  Social-Directive  (SD) 

iii  - Corijine  tire  rankings 

(4)  V'Jho  has  the  most  ability  to  tliin):  critically  and 
analytically? 

Primary  i?aramsters:  Quanity  of  Verlaal  Camiunication 

and  Categorize/Sumrarize 
Infonration  pixcessing  rules: 

i - Ran}:  group  on  Quajitity  of  Verbal  Caununication  (Q:'C) 
ii  - Rink  group  on  Categorize/Sumarize  (C/S) 
iii  - Cenbine  t}ie  ranJeings 


I 


1 


(5)  WitJi  whan  can  you  work  best? 

Prbraiy'  paraiioter;  Mutual  Influence  ■ 

Infonnation  processing  rule: 

i - Rank  group  oii  Mutua].  Influence  (MI) 

(6)  \’}ho  sha-^s  the  greatest  independence  of  thought? 

Primary  poraineters:  No  clear  indication  frem  protocols 

(7)  hlio  sha.’/s  the  best  overall  leadership  qualities? 
Primary'  parameters:  Social-Directive  emd  Mutual 

Influence 

Information  processing  rules: 

i - Rank  group  on  Social-Directive  (SD) 
ii  - Rank  group  on  Mutual  Influence  (MI) 
iii  - Coibine  the  rankings 


It  is  on  the  basis  of  such  naive  infonration  processing  rules  that 
predictions  were  made  for  each  group  as  to  their  rank  order  on  each 
sociomotric  cjuesticn.  TaJ^les  2-7  sumn\arize  the  results  for  Study  1 
for  each  sccionetric  question.  In  each  case,  the  Spearman  rank  correla- 
tion coefficient  is  calculated  for  each  of  the  infomiation  processing 
rules. 

An  additional  model  is  sha-m  for  the  sociometric  "Kho  is  pulling 
most  for  the  group?"  Tire  decision  rules  are  as  fol lav’s: 

Primary  paraaieters:  Social-Directive  and 
Quantity  of  Verbal  Ccaraunication 

Information  processing  rules: 

i - Ranlc  group  on  Social-Directive  (SD) 
ii  - Rrink  group  on  Quantity  of  Verbal  Ccrnmunication  (QVC) 

V - Cembine  the  ranlcings 

This  nerw  model,  omitting  the  Listening  factor,  proved  to  be  a more 
significant  predictor  of  the  group  peer  rarOdng  for  all  groups  except 
one,  of  tliese,  all  w’cre  significant  at  the  .05  level  with  four  sigiii- 
f leant  at  tlie  .01  level. 


4 
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T£ible  2.  Si:ieanran  ran}:  correlation  bct\vcen  actual  aggregate 
peer  ranliings  and  predictions  based  upon  the  infcr- 
imtion  pixcessincj  rules. 

1.  \>’ho  \vould  you  go  to  for  help  on  a tough  problem  i? 


Information 

\^Processing 

„ N.  Ffules 
Group  \ 


i 

L 

11 

MI 

111 

L •+  Ml 

.919** 

.776* 

-830* 

.785* 

.464 

.669 

.928** 

.785* 

.875* 

.785* 

.776* 

.758* 

.625 

.825 

.975* 

1.000** 

.785* 

.937** 

.893** 

.571 

.633 

.642 

.642 

.642 

.571 

.750* 

1758* 

n = 5 


-'n  = 6 


p > .05 

£ > .01 
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Tiible  3.  S{.)cari,kxn  rank  correlation  bot.\\«eM  actioal  agqregate 
peer  rankinqo  aiid  ))redictior3  bascci  uion  the  infor- 
ms tion  processing  x'ulos. 

2.  VJlio  is  pulling  nost  for  tJie  group? 


u rr 

n = 5 

n = 6 
*p  > .05 
**£  > .01 


Infonn.itiojx 

Processing 


Group^\^ 

ftales 

i 

SD 

ii 

QVC 

iii 

L 

iv 

SD+L+P/C 

V 

]. 

.946** 

.785* 

.893** 

.893** 

.893** 

2 

i 

.946** 

.857* 

.642 

.955** 

.893** 

3 

.928** 

.857* 

.821* 

.883* 

.857* 

4 

.991** 

.875* 

.893** 

.982** 

.964** 

6^ 

.700 

1.000** 

.625 

.800 

.900* 

7 

1 

.955** 

.794* 

.901** 

.928** 

.937** 

8 

.964** 

.732* 

.839* 

.803* 

.839* 

gb 

.728 

.071 

.314 

.271 

.457 

10 

.812* 

.866* 

.553 

.821* 

.857* 
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Table  4.  Specimu’xi  rank  correlation  beteeen  actual  ac." 

peer  rarJdngs  and  predictions  based  ufxan  tin 
naticxi  processing  ru2.es. 

3.  hbo  is  best  at  handling  people? 


gregate 
infor- 


iii 

I'll  + SD 


.883* 

.893** 

.776* 

.893** 

1.000** 
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Tablo  5.  Sj-xianruu)  rank  correlation  bet\,'een  actual  aggregate 

peer  rankings  and  prcxiictions  based  upon  the  infor- 
nvation  processing  rules. 


4.  V\lio  has  the  most  ability  to  thiji):  critically  and  analytically? 


InforiTiation 


Processing 

V.  Rules 

Groap 

i 

QVC 

ii 

C/S 

iii 

QVC  + C/S 

1 

.964** 

.482 

. 821* 

2 

.928** 

.035 

.535 

3 

.964** 

.857* 

.964** 

4 

.883* 

.830* 

.964** 

6^ 

.900* 

0 

.725 

7 

.750* 

.866* 

.785* 

8 

.830* 

- 

.830* 

9^ 

.514 

.214 

.414 

10 

.705 

- 

.705 

* £>  .05 

**  £>  .01 


Spc'arman  I'cm]-:  correlation  betaveen  actual  aggregate 
peer  rankings  and  predictions  b£\sed  uixjn  the  infor- 
nation  prcx:essing  ru].es. 


5.  With  whan  can  you  work  best? 


982** 


r ' ■ ^ ^ 
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Table  7.  Spearman  ran]c  correlation  betl^?eGn  actua]  aggregate 
p(X>r  rankings  and  prodictions  based  upon  the.  infor- 
nrit-ion  processing  rules. 


7.  VJho  sha/s  the  best  overall  leadership  qualities? 


* £ > .05 

**  p_  > .01 
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Overall,  the  predictive  paver  of  the  models,  developed  frcm  tlie 
protocol  analysis,  is  high.  It  appears,  ha-.’ever,  that  equally  good 
or  better  predictions  are  obtained  using  sin^:)ler  models  than  those 
derived  frcn  the  protocols  analysis.  This  is  true  for  all  socio- 
metrics  except  "Kith  whom  can  ^tou  work  best?"  For  exanple,  the  ircdel 
based  on  tlie  Listening  rule  by  itself  appe£urs  to  be  better  for  the 
socicnetric  "Ivho  would  you  go  to  for  help  on  a tough  problaii?"  Using 


the  criteria  that  the  higher  tiie  SpeanTan  r^  values  the  better  tlie  rank  j 

correlations,  six  of  the  nine  groups  had  higher  r^  values  using  this  | 

simpler  model  over  the  previous  one  which  was  corposed  of  the  Listen-  ] 

i 

ing  and  Mutual  Influence  factors.  As  was  nentioned,  for  "\'?ho  \-ias 
pulling  most  for  the  group?"  the  sinpler  model  corbining  tlie  factors 
of  Social-Directive  and  Quantity  of  Verbal  Comunicaticn  had  eight 
higher  r^  values  than  the  model  derived  from  the  protocols  which  in- 
cluded these  two  factors  in  addition  to  the  Listening  parameter.  For 
the  sociccnetrics  "Kho  is  best  at  handling  people?"  eind  ";Vho  shews  the 
best  overall  leadership  qualities?",  the  model  based  on  the  Social- 
Directive  factor  by  itself  appears  to  be  statistically  better  than 
the  model  based  on  the  Social-Directive  and  Mutual  Influence  factors 
together,  with  seven  and  six  of  the  nine  groups  having  higher  r^ 
values  respectively.  Finally,  the  model  using  the  Quantity  of  Verbal 
Cannunication  rule  only,  appears  to  have  better  predictive  validity 
on  "Who  has  the  ability  to  think  most  critically  and  analytically?" 
with  four  higher  r^  values  than  the  protocol  analysis  model  which  con- 
sisted of  the  Quantity  of  Verbal  Ccrminicaticn  and  Categorizing/ 

Sunnarizing  parameters. 


r 
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The  SpeeuTivam  rank  correlation  is  a yood  indicator  of  a niodel's 
predictive  jxAver  for  a particular  group,  ha\’e\'er,  it  is  not  sei'isitive 
enough  for  making  a selection  betv-.’een  tJie  models  for  a socicmetric 
over  all  groups  in  general.  This  is  duo  to  tliat  fact  that  tlie  r^ 
is  caluculated  for  each  individual  group  and  thus  the  r^odels  are 
not  evaluated  cr^er  all  of  the  groups  in  the  aggregate.  One  nethod 
to  determine  \diich  nxjdels  are  be^t  over  all  groups  is  to  perform  a 
cenparative  frequency  analysis  of  the  deviatiens  of  the  various 
models  from  the  actual  aggregate  peer  rankings.  In  othervrords,  using 
the  same  data,  the  frequency  for  \drLch  there  was  a perfect  imtch 
betiveen  a nKxiel  and  the  actual  aggregate  peer  ranius,  \diere  the 
model  prediction  \i7as  off  by  one  adjacent  rarft,  off  by  two  ranks, 
etc.,  is  calculated.  Table  8 illustrates  this  procedure. 


Table  8.  Example  of  a perfect  correlaticn  of  the  model 

for  a socicmetric  with  the  actual  peer  rankings. 

I4odel  Predictions 


f 
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In  this  exanple,  v^ere  there  are  ones  along  tJio  diagonal,  tlie 
model  predictions  are  perfectly  correlated  with  the  actual  peer 
raiJcLrigs,  there  are  no  deviations.  Tliis,  of  course,  is  the  ideal 
model.  In  each  case,  the  closer  a model  is  to  looking  like  this 
table  the  bettor  it  is.  Hence,  in  selecting  \\iu.ch  model  is  best 
over  all  groups  on  a particular  sociometric  one  v/ould  choose  tbat 
model  which  nunimizes  the  overall  deviatiais. 

As  yet,  this  nethod  of  analyses  has  not  been  corrpleted.  Further 
results  will  be  reported  in  a future  teclmical  report. 


DISCUSSION 

The  results  to-date  can  be  viewed  as  strongly  supportive  of  the 
experirrental  approach  taken  in  this  researcli.  The  naive  additive 
models  seem  to  capture  the  essential  information  v/hich  is  being  pro- 
cessed by  the  subjects;  and  they  are  basically  sipportive  of  the 
human  problem  solving  theory  proposed  by  Ns-^ell  and  Simon  (1972) . 

The  effectiveness  and  sinplicity  of  these  unr.s^eighted  cognitive  pro- 
cessing models  — witli  regards  to  the  few  and  cperatiojially  defined 
decision  rules  v^ich  represent  the  infoimiation  being  processed  by 
the  subjects  — are  encouraging  with  regards  to  their  potential  im- 
plications for  decision  process  modelling  research  on  managerial 
selection  and  cissessment,  management  development,  and  organizational 
design. 

Surprisingly,  it  appears  that  even  sinplcr  models  exist  which 
predict  the  peer  rating  criteria  thcin  those  derived  frem  die  protocol 
cinalysis;  p»rticularly  in  those  instances  wliere  nonvej-bal  ccnmunication 


! 

1 


I 


J 
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is  a primary  factor.  For  all  of  the  socicrre tries , except  for  the 
q\x;stioh  concerning  critical  ajid  analytical  thinJang,  the  processing 
of  nonverbal  cues  v.’as  a crucial  coTiponent  in  fonring  a judgement. 

For  exajrple,  tlie  primry  paraincter,  as  indicated  by  the  protocols, 
for  tlie  socicmetric  "U’ith  \.''han  can  you  work  best?"  is  Mutual  Influence. 
This  factor  corrbines  infomation  obtained  frem  (1)  verbal-  ccrinani  cations 
(i.e.  those  interactions  which  connote  give  and  ta}'.e:  agreeaents , 
disagreements,  a:-d  building)  ; emd  (2)  non\arbal  conmunications 
(i.e.  dogiratic-aggressive  characteristics:  rigid  body  posture, 
poor  eye-contact,  no  head  nodding,  etc.).  Table  9 shov7s  the  r^ 
scores  for  -the  ^^utual  Influence  factor,  first  conputed  using  the 
verbal  give  and  -take  caimunications  only,  second  is  tlie  same  score 
with  thie  nonverbal  dognatic-aggressive  behaviors  added.  It  is  clear 
from  the  increase  in  tlie  significance  of  the  r^  values, when  tlie 
nonverbal  connunications  are  considered  in  the  Mutual  Influence  score, 
that  it  is  an  inportant  variable.  Using  a bso-tailed  t Test  tlie  two 
series  of  r values  are  significantly  different  at  -tlie  .01  level. 


Table  9.  Spearman  rank  correlations  for  the  predictions  of  a 

iTodel  with  ajid  without  nonverbal  cairvanications  considei'ed. 


5.  Kith  whom  can  you  w'ork  best? 


Model:  Mutual  Influence 


Group 


^ n = 5 


Verbal  (give  & take) 


.929** 

.429 

.857* 

.839* 

.075 

.384 

.607 

.243 

.489 


Verbal  & Nonverbal  (dogn-otic  fi 

aggressive) 


.982** 

.821* 

.857* 

.839* 

.925* 

.723* 

.607 

.814 

.741* 


n = 6 


E>  .05 


E > ,01 
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A j.\.')ssible  e^xplarmtioi i for  the  do-iui'mcc  of  norr/erbal  infonia-  ; 

tion  in  tlxise  IP  rrodels  ray  be  obtained  fran  a furtlier  exaau ration  of  i 

J 

J 

the  group  situation  itself.  In  such  a group  discussiai  with  six  other  ! 

individuals  to  listen  to,  interact  witli,  ai-sd  judge,  it  is  jxDssible 
that  there  may  bo  an  infoiration  overload.  For  exarale,  in  order 
for  a person  to  rank  the  six  otlier  members  of  Iris  group  on  the  socio- 
inetric  "V^ith  whom  can  you  work  best?"  he  would  first  have  to  ma};e  a 
judgement  on  the  give  £ind  tal'.e  exclianges:  i.e.  ha-;  many  times  each 
member  agreed,  disagreed  and  b’oilt  on  his  ideas.  Next,  he  would 
have  to  recall  the  various  nonverbal  cues  elicited  by  each  member 
indicating  dogmatism,  aggression  and  listening;  add  this  to  his  ’ 

count  of  give  and  take  exchanges;  and  finally  £irrive  upon  a ranking 
for  all  six  members.  | 

Therefore,  it  seaTis  likely  tliat,  in  such  an  information  rich 
environment,  a subject  makes  an  attribution  on  ha^  a person  would 
ranlc  on  these  sociametrics  using  nonverbal  information  as  a surregate 
for  processing  a detailed  account  of  all  the  verbal  transactions.  It 
is  possible  that  persons  form  opinions  of  their  peers  early  in  the 
ccrmunication  and  rely  thereafter  more  lieavily  on  the  nonverbal 
rather  than  the  verbal  information.  Prior  research  lias  sha^ml  (Lewin, 

Dubno,  Akula  (1971) ; Hollander,  1956  a,  1957,  1965)  that  valid  and 
reliable  peer  evaluations  arc  obtainable  in  relatively  brief  inter- 
action times.  This  is  £in  interestuig  research  question  which  may 
be  efisily  ans^^?ered  fraii  our  videotaped  record  of  the  group  interactions. 

Another  interesting  finding  is  the  ccnmonality  of  the  underlying 
models  for  the  socicmetrics . There  apj-x^curs  to  be  no  separate  descrip- 
tors from  each  subject  for  each  group,  instead  a coiisistcnt  conmon 
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set.  of  desciiptx)!'.-^  gtk21"9G  for  each  socicrxstric,  except  for  the  cjuestion 
"l-.’ho  sho.vs  tjio  greatest  irdependence  of  thouc^t?",  where  no  canron  set 
of  descriptors,  vfeicli  could  be  score-d,  \.’ere  identified.  This  finding 
lends  suijport  fo.r  the  netliod  of  developing  situational  process  des- 
criptors for  ha-.'  jXKcple  attribute  beha\ioral  characteristics  to  others. 

Our  research  findings  ha’ve  a direct  bearing  on  the  literature 
describing  the  emergent  leader  of  a grorn  as  that  aieirber  who  tallrs 
most  frequently,  independent  of  tie  content  of  his  verbalizations 
(Bass,  1949;  Norfleet,  1948;  Bales,  1953;  Borgotta  and  Bales,  1956; 

Kirch,  Lodalil  and  Haire,  1959;  Riecken,  1958;  Regula  and  Julian,  1973). 
Due  to  the  fact  that  no  study  had  sham  that  tiie  quality'  of  a person's 
contributions  modifies  the  leadership  ratings  he  reKoeives  (cf.  (Riecken, 
1958;  Bavelas,  Hastorf,  Gross,  and  Itite,  1965;  Regula  and  Julian,  1973)) 
eind  that  other  research  findings  (e.g.  Stogdell,  1948;  Julian,  Hollander, 
and  Regula,  1969)  indicate  float  perceived  and  actual  ccrpetence  (pre- 
sunoaloly  related  to  the  quality  of  carrrunication)  are  irrportant  deter- 
minants of  leadership,  Sorrentino  and  Boutillier  (1975)  set  a study 

to  investigate  the  relationship  bsb.-.'een  quantity'  and  quality  of  verbal 
interaction  on  the  leadership  process.  The  two  Vciriables  were  systemti- 
cally  varied  in  an  unambiguous  group  situatiao  (e.g.  High  Quaootity'  - 
Lct-7  Quantity,  etc.).  Their  results  indicate  that  v;hile  quality  of 
verbal  interaction  was  found  to  predict  perceived  differences  on  such 
veu'iables  as  competence,  influence, and  contributicn  to  the  group's 
goal,  only  quanity  of  verbal  conmunication  predicted  perceived 
differences  in  leadership  ability. 

direct  testing  of  Sorrentino  iond 
the  conplete  record  of  the  verbal 


txaiisacLior.s  — tiie  nunt)er  of  words  spo-tcjn,  tine  length  of  verbal!-  ] 


I 

zatioi';;";,  the  content  and  order  of  ccnTOunications  — enabled  us  to  • 

test  the  relationship  beteecn  the  quantity  of  verba.1  ccrrnunications 

and  the  raifdLngs  on  all  sociaac tries.  Specifically,  v.’e  n'easured  t.hs  ] 

quantity  of  verbal  inter-action  by  the  nunhiar  of  utterances  and  by 
the  number  of  opinions  stated.  Keitlier  of  tliese  measures  were  sig- 
nificaiit  in  predicting  the  peer  ranking  criterion  for  a].l  sociometrics 
except  one  — "UTio  has  the  most  ability  to  tliink  critically  cind 
analytically?"  In  addition,  tire  quantity'  of  verbal  canrranication 
v^as  indicated  as  one  of  the  too  primary-’  parameters  for  the  ircdel  of 
the  sociametric  "VJlro  is  pulling  most  for  the  group?".  Of  particulcir 
interest  is  the  relationslrip  betoeen  the  quantity'  of  verbal  comrnuni- 
cation  and  the  peer  rankings  for  the  question  "hlro  sha-zs  the  best 
overall  leadership  qualities?”  No  correlation  was  found  between  tire 
ranlcing  based  on  the  quanity  of  verbal  caiiruirication  arxl  the  actual 
peer  rankings  for  this  question.  This  is  not  surprising,  has-ever, 
since  quanity  was  not  heavily  expressed  in  the  protocols  as  being  an 
important  leadersliip  quality. 

In  general,  we  may  conclude  tlrat  tire  findings  from  oirr  study  con- 
tradict tire  earlier  findings  that  the  q'uairtity  spoken  is  more  critical 
than  the  quality'  of  interactions  when  it  canes  to  attributing  leader- 
ship. The  fact  that  we  found  that  the  number  of  opiirions  expressed 

had  o\'crall  higher  r values  than  those  obtained  from  a straight  word 
— s 

count,  in  iirself , iirdicates  that  subjects  were  making  some  judgenrent 
on  tire  content  of  the  cormunications. 


Riedien  (1958)  rcixrrts  evidence  tlr^t  unless  a group  member  has  a 
high  participation  rate  in  tire  early  stages  of  tire  groiq)  discussion, 
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otlior  rrcnters  will  not  attend  to  him  even  if  he  comes  up  \«.tli  aji 
"elegant  solution"  to  the  group's  tas}:.  In  t-.’o  of  our  grou[j3  tiris 
notion  vris  not  sipported.  In  both  cases  a meriber  v.dhh  a considerably' 
lo;  overall  rate  of  participation  vras  ranked  high  on  ]eadersliip  abilities 
Ix'cause  of  his  opinions  or  suggestions  late  in  tl'.e  discussion  concern- 
ing the  grouji's  task. 

The  findings  of  tliis  study  irexy  also  have  inplications  to  another 
large  body  of  research  on  leader  behavior.  Specifically,  tlia  .''lutual 
Influeiice  factor  has  not  been  given  explicit  recognition  in  the 
Consideration  and  Initiating  Structure  literature.  Hollcinder  (1976) 
has  also  noted  t!ie  irrportance  of  a similar  factor  in  the  leadership 
process  when  he  refers  to  a "transactional"  social  exchange.  This 
"lias  to  do  with  the  leader-folla.ver  relationship  in  the  aggregate, 
including  tlie  follavers  perceptions  and  expectatioris , the  availability 
of  ta-/o-v;ay  influence,  and  e>:change  of  ravards"  (1976  p.l).  Our  findings 
not  only  indicate  that  a mutual  influencing  exchange  is  a vital  cenpo- 
nent  in  one-to-one  relationships,  but  that  it  is  also  inportant  for 
a leader  to  have  this  type  of  exchange  is'ith  the  majority  of  the  group 
members.  Tliis  is  consistent  v;ith  Leavitt's  (1951)  findings  on  effec- 
tive ccTitnunicati  on  netiTOrks.  His  results  indicatod  tliat  tlie  vrnecl 
network  produces  tlie  liest  orgemized  cuid  fastest  performance.  Tliis 
is  the  most  centralized  of  Leavitt's  (1951)  four  netivorks,  where  one 
person  — who  usually  becaies  the  leader  — is  the  focus  of  ccnnients 
frm  each  member  of  the  group. 

liirthcr,  our  results  suggest  other  activities  \daich  arc  not 
specified  in  the  Initiating  Structure  dimension  of  leadership.  Ke 
found  tw  Icadciship  qualities  v,iiich  help  structure  the  decision- 
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nuldjng  group:  tlie  ability  to  provide  direction  OJid  tlie  pcv.’er  to  facilitate 
probleni  solving.  The  descriptors  v.’hich  idcntificri  tlie  quality  of  giving 
direction  include  "initiating  and  organizing  the  discussion,"  "soliciting 
ideas  fraa  other  participants"  and  "keeping  tlio  discussion  on  track." 

Ihs  descriptors  of  "categorizing  and  sunTiBrizing"  and  "having  a ccerpre- 
hensivG  vierA’  of  tlie  problem" , etc . , proved  to  be  i ixlicative  of  the 
ability  to  facilitate  problem  solving  by  giving  perspective  and  guide- 
lines to  the  discussion.  In  addition,  as  was  indicated  in  tlie  protocol 
analyses,  to  be  most  effective  a leader  must  be  able  to  perform  these 
directive  behaviors  in  a socially  acceptable  rranrier.  This  means 
listening  and  being  considerate  of  others'  opinions  as  well  as  giving 
structure  to  the  group. 

Although  ccnplemantary  to  tiie  literature,  the  results  of  this  re- 
search poicn£Lntly  reveal  the  need  for  furtiier  investigation  into  leader- 
ship attribution  tlieory. 
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